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TITkE QF THE INVENTION 

MUSIC REPRODUCTION SYSTEM, MUSIC EDITING SYSTEM, MUSIC 
EDITING APPARATUS , MUSIC EDITING TERMINAL UNIT, MUSIC 
5 REPRODUCTION TERMINAL UNIT, METHOD OF CONTROLLING A MUSIC 
EDITING APPARATUS, AND PROGRAM FOR EXECUTING THE METHOD 

BACKGROUND QF THE INV ENT ION 

10 Field of the Invention 

The present invention relates to a music 
reproduction system, a music editing system, a music 
editing apparatus, a music editing terminal unit, a music 
reproduction terminal unit, a method of controlling a 

15 music editing apparatus, and a program for executing the 
method, and more particularly to a music reproduction 
system, a music editing system, a music editing apparatus, 
a music editing terminal unit, a music reproduction 
terminal unit, and a method of controlling a music 

2 0 editing apparatus, which enable a user to realize a 

desired musical concept in his/her mind and apply various 
sound effects to music, by simple operations, as well as 
a program for executing the method, 

25 Description of the Related Art 

In general, some users who are fond of listening to 
musical performance desire to enjoy not only listening to 
performance tones generated by reproduction of music data 
(e.g. MIDI (Musical Instrument Digital Interface) data, 

30 but also editing the music data in accordance with a 

desired musical concept in his/her mind and listening to 
performance tones generated by reproduction of the music 
data of his own editing. 

Conventionally, users having such a desire utilize 

35 various music data-editing software installed on personal 
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computers of their own or the like, to edit the existing 
music data of a piece of music e.g. by changing 
performance tempo of the piece of music, or applying 
desired acoustic effects (such as a reverberation effect) 
5 thereto . 

However, in the case of utilizing a personal 
computer or the like to edit music data as described 
above, it is necessary for the users to cause the 
computer to once read the existing music data, and then 

10 add or change control codes for realizing the musical 
concept in his/her mind and control codes for applying 
acoustic effects (e.g. a control code for applying a 
reverberation effect) , on a tone-by- tone, measure-by- 
measure, or phrase-by-phrase basis, which inevitably 

15 takes the users a lot of labor and time. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide 
20 a music reproduction system, a music editing system, a 

music editing apparatus, a music editing terminal unit, a 
music reproduction terminal unit, and a method of 
controlling a music editing apparatus, which enable music 
editing and acoustic effect application by simple 
25 operations, for realization of a desired musical concept 
in his/her mind, as well as a program for executing the 
method. 

To attain the above object, in a first aspect of the 
present invention, there is provided a music reproduction 

30 system comprising an operating terminal unit that can be 
carried by an operator, and generates motion information 
in response to motion of the operator carrying the 
operating terminal unit, a music editing apparatus that 
receives the motion information from the operating 

35 terminal unit and edits music data of a piece of music to 
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be reproduced based on the received motion information, 
and a musical tone generating device that reproduces the 
edited music data supplied from the music editing 
apparatus to generate musical tones, wherein the music 
5 editing apparatus comprises a detector device that 

detects peak information indicative of magnitude of the 
motion of the operator from the received motion 
information, a control information generating device that 
generates music reproduction control information for 

10 controlling music reproduction of the piece of music, 
based on the peak information, when a peak value 
indicated by the peak information is larger than a first 
predetermined threshold value and a second predetermined 
threshold value, and generates acoustic effect control 

15 information for controlling at least one acoustic effect 
to be applied to the piece of music, based on the peak 
information, when the peak value indicated by the peak 
information is larger than the first predetermined 
threshold value and smaller than the second predetermined 

2 0 threshold value, a music data editing device that edits 
the music data based on the music reproduction control 
information and the acoustic effect control information 
generated by the control information generating device, 
and an output device that outputs the music data edited 

25 by the music data editing device to the musical tone- 
generating device. 

With the above arrangement of the music reproduction 
system according to the first aspect of the present 
invention, the music editing apparatus analyzes motion 

30 information received from the operating terminal unit to 
detect peak information indicative of magnitude of the 
motion, and when a peak value indicated by the peak 
information is larger than the first threshold value and 
at the same time larger than the second threshold value, 

35 generates music reproduction control information for 
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controlling music reproduction of the piece of music (for 
controlling e.g. performance tempo and volume), while 
when the peak value is larger than the first threshold 
value and at the same time smaller than the second 
5 threshold value, the music editing apparatus generates 
acoustic effect control information for controlling at 
least one acoustic effect to be applied to the piece of 
music (for controlling e.g. a reverberation effect or a 
tone extension effect) . Then, the music editing 

10 apparatus edits existing data based on the generated 

information, and the edited music data is output to the 
musical tone-generating device, for being sounded as 
reproduced musical tones. Thus, the operator can control 
reproduction of the music data and acoustic effects to be 

15 applied to the music data, merely by simple operations of 
the operating terminal unit, thereby achieving 
realization of a musical concept in the operator's mind 
and application of acoustic effects to the piece of music 
as he desires. As a result, even a beginner having no 

20 knowledge of MIDI or the like can easily and 

institutively apply acoustic effects to the original 
piece of music. 

To attain the above object, in a second aspect of 
the present invention, there is provided a music editing 

25 system comprising an operating terminal unit that can be 
carried by an operator, and generates motion information 
in response to motion of the operator carrying the 
operating terminal unit, and a music editing apparatus 
that receives the motion information from the operating 

3 0 terminal unit and edits music data of a piece of music 
to be reproduced based on the received motion 
information, wherein the music editing apparatus 
comprises a detector device that detects peak 
information indicative of magnitude of the motion of the 

35 operator from the received motion information, a control 
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information generating device that generates music 
reproduction control information for controlling music 
reproduction of the piece of music, based on the peak 
information, when a peak value indicated by the peak 
5 information is larger than a first predetermined 

threshold value and a second predetermined threshold 
value, and generates acoustic effect control information 
for controlling at least one acoustic effect to be 
applied to the piece of music, based on the peak 

10 information, when the peak value indicated by the peak 
information is larger than the first predetermined 
threshold value and smaller than the second predetermined 
threshold value, and a music data editing device that 
edits the music data based on the music reproduction 

15 control information and the acoustic effect control 
information generated by the control information 
generating device. 

To attain the above object, in a third aspect of the 
present invention, there is provided a music editing 

2 0 apparatus comprising a receiver device that receives, 

from an operating terminal unit that can be carried by an 
operator, motion information generated in response to 
motion of the operator carrying the operating terminal 
unit, a detector device that detects peak information 

25 indicative of magnitude of the motion of the operator 
from the motion information received by the receiver 
device, a music reproduction control information 
generating device that generates music reproduction 
control information for controlling music reproduction of 

30 a piece of music, based on the peak information, when a 
peak value indicated by the peak information is larger 
than a first predetermined threshold value and a second 
predetermined threshold value, an acoustic effect control 
information generating device that generates acoustic 

3 5 effect control information for controlling at least one 
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acoustic effect to be applied to the piece of music, 
based on the peak information, when the peak value 
indicated by the peak information is larger than the 
first predetermined threshold value and smaller than the 
5 second predetermined threshold value, and a music data 
editing device that edits music data of the piece of 
music based on the music reproduction control information 
and the acoustic effect control information generated by 
the music reproduction control information generating 

10 device and the acoustic effect control information 
generating device, respectively. 

Preferably, the music editing apparatus further 
comprises a locus shape identifying device that 
identifies a shape of a locus drawn by the operating 

15 terminal unit in accordance with the motion of the 

operator, based on the motion information, when the peak 
value indicated by the peak information is larger than 
the first predetermined threshold value and smaller than 
the second predetermined threshold value, and a first" 

2 0 storage device that stores locus shape information 

indicative of shapes of loci to be drawn by the operating 
terminal unit and acoustic effect item information 
indicative of acoustic effects to be applied to the piece 
of music, in association with each other, and the 

25 acoustic effect control information generating device 

searches the first storage device using the shape of the 
locus identified by the locus shape identifying device, 
as a retrieval key, to obtain corresponding acoustic 
effect item information, and then generates the acoustic 

30 effect control information for controlling the acoustic 
effect indicated by the obtained acoustic effect item 
information, based on the peak information. 

More preferably, the locus shape identifying device 
identifies not only the shape of the locus drawn by the 

35 operating terminal unit in accordance with the motion of 
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the operator, but also a direction of the locus, based on 
the motion information, the first storage device storing 
the locus shape information, locus direction information 
indicative of directions of the loci, and the acoustic 
5 effect item information, in association with each other, 
and the acoustic effect control information generating 
device searching the first storage device using the shape 
of the locus and the direction of the locus identified by 
the locus shape identifying device, as retrieval keys, to 

10 obtain the corresponding acoustic effect item information 
from the stored acoustic effect item information, and 
then generates the acoustic effect control information 
for controlling the acoustic effect indicated by the 
obtained acoustic effect item information, based on the 

15 peak information. 

More preferably, the music editing apparatus further 
comprises a second storage device that stores peaks 
values of the peak information and acoustic effect level 
values indicative of magnitude of each of acoustic 

20 effects to be applied to the piece of music, in 

association with each other, and the acoustic effect 
control information generating device searches the second 
storage device using the peak information detected by the 
detector device, as a retrieval key, to obtain a 

25 corresponding acoustic effect level value from the stored 
acoustic effect level values, and searches the first 
storage device using the shape of the locus and the 
direction of the locus identified by the locus shape 
identifying device, as retrieval keys, to obtain the 

3 0 corresponding acoustic effect item information from the 
stored acoustic effect item information, and then 
generates the acoustic effect control information based 
> on the obtained acoustic effect level value and the 
obtained acoustic effect item information. 

35 To attain the above object, in a fourth aspect of 
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the present invention, there is provided a music editing 
terminal unit comprising a motion information generating 
device that can be carried by an operator, and generates 
motion information in response to motion of the operator, 
5 a music editing device that edits music data of a piece 
of music to be reproduced based on the motion information 
generated by the motion information generating device, a 
detector device that detects peak information indicative 
of magnitude of the motion of the operator from the 

10 motion information, and a control information generating 
device that generates music reproduction control 
information for controlling music reproduction of the 
piece of music, based on the peak information, when a 
peak value indicated by the peak information is larger 

15 than a first predetermined threshold value and a second 
predetermined threshold value, and generates acoustic 
effect control information for controlling at least one 
acoustic effect to be applied to the piece of music, 
based on the peak information, when the peak value 

20 indicated by the peak information is larger than the 

first predetermined threshold value and smaller than the 
second predetermined threshold value, wherein the music 
editing device edits the music data based on the music 
reproduction control information and the acoustic effect 

25 control information generated by the control information 
generating device. 

To attain the above object, in a fifth aspect of the 
present invention, there is provided a music reproduction 
terminal unit comprising a motion information generating 

30 device that can be carried by an operator, and generates 
motion information in response to motion of the operator, 
a music editing device that edits music data of a piece 
of music to be reproduced based on the motion information 
generated by the motion information generating device, a 

3 5 detector device that detects peak information indicative 
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of magnitude of the motion of the operator from the 
motion information, and a control information generating 
device that generates music reproduction control 
information for controlling music reproduction of the 
5 piece of music, based on the peak information, when a 
peak value indicated by the peak information is larger 
than a first predetermined threshold value and a second 
predetermined threshold value, and generates acoustic 
effect control information for controlling at least one 

10 acoustic effect to be applied to the piece of music, 
based on the peak information, when the peak value 
indicated by the peak information is larger than the 
first predetermined threshold value and smaller than the 
second predetermined threshold value, wherein the music 

15 data editing device edits the music data based on the 

music reproduction control information and the acoustic 
effect control information generated by the control 
information generating device, and outputs the edited 
music data to the musical tone generating device. 

20 To attain the above object, in a sixth aspect of the 

present invention, there is provided a method of 
controlling a music editing apparatus that edits music 
data of a piece of music to be reproduced, comprising the 
steps of receiving, from an operating terminal unit that 

25 can be carried by an operator, motion information 

generated in response to motion of the operator carrying 
the operating terminal unit, detecting peak information 
indicative of magnitude of the motion of the operator 
from the received motion information, generating music 

30 reproduction control information for controlling music 
reproduction of the piece of music, based on the peak 
information, when a peak value indicated by the peak 
information is larger than a first predetermined 
threshold value and a second predetermined threshold 

35 value, generating acoustic effect control information for 
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controlling at least one acoustic effect to be applied to 
the piece of music, based on the peak information, when 
the peak value indicated by the peak information is 
larger than the first predetermined threshold value and 
5 smaller than the second predetermined threshold value, 
and editing the music data based on the generated music 
reproduction control information and the generated 
acoustic effect control information. 

To attain the above object, in a seventh aspect of 

10 the present invention, there is provided a program for 
causing a computer to execute a method of controlling a 
music editing apparatus that edits music data of a piece 
of music to be reproduced, the program comprising a 
module for receiving, from an operating terminal unit 

15 that can be carried by an operator, motion information 

generated in response to motion of the operator carrying 
the operating terminal unit, a module for detecting peak 
information indicative of magnitude of the motion of the 
operator from the received motion information, a module 

20 for generating music reproduction control information for 
controlling music reproduction of the piece of music, 
based on the peak information, when a peak value 
indicated by the peak information is larger than a first 
predetermined threshold value and a second predetermined 

25 threshold value, a module for generating acoustic effect 
control information for controlling at least one acoustic 
effect to be applied to the piece of music, based on the 
peak information, when the peak value indicated by the 
peak information is larger than the first predetermined 

3 0 threshold value and smaller than the second predetermined 
threshold value, and a module for editing the music data 
based on the generated music reproduction control 
information and the generated acoustic effect control 
information. 

35 The above and other objects, features, and 
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advantages of the present invention will become more 
apparent from the following detailed description taken in 
conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a view showing the arrangement of a music 
reproduction system according to an embodiment of the 
present i n ven t i on ; 

FIG. 2 is a perspective view of the appearance of an 
operating terminal unit of the music reproduction system 
shown in FIG. 1; 

FIG. 3 is a block diagram showing the construction 
of the operating terminal unit shown in FIG. 2; 

FIG. 4 is a block diagram showing the arrangement of 
a personal computer system in FIG. 1; 

FIG. 5 is a block diagram useful in explaining 
functions of the personal computer system in FIG. 4; 

FIG. 6 is a timing chart showing, by way of example, 
changes in an acceleration value of the operating 
terminal unit shown in FIG. 2; 

FIGS. 7A and 7B are diagrams useful in explaining 
movement locus information of the operating terminal unit 
in FIG. 2 generated by a locus shape/direction detector 
appearing in FIG. 5, in which: 

FIG. 7A shows an example of a locus drawn by the 
operating terminal unit shown in FIG. 2; and 

FIG. 7B shows an example of the movement locus 
information generated by the locus shape/direction 
detector in FIG 5 according to the locus of the operating 
terminal unit shown in FIG. 2; 

FIGS. 8A to 8F are diagrams showing, by way of 
example, shapes of loci of the operating terminal unit 
shown in FIG. 2, stored in the personal computer system 
shown in FIG. 4, in which: 
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FIG. 8A shows movement locus information of a figure 

of 8; 

FIG. 8B shows movement locus information of an 
obliquely cut shape ; 
5 FIG. 8C shows movement locus information of a square 

shape ; 

FIG. 8D shows movement locus information of a spiral 
shape ; 

FIG. 8E shows movement locus information of a saw- 
10 toothed shape; and 

FIG. 8F shows movement locus information of a 
triangular shape; 

FIG. 9 is a diagram useful in explaining an acoustic 
effect item determination table stored in a memory in FIG. 
15 4; 

FIG. 10 is a diagram useful in explaining an 
acoustic effect level determination table stored in the 
memory in FIG. 4; 

FIG. 11 is a diagram useful in explaining existing 
20 music data stored in an existing music data storage 
device in FIG. 5; 

FIG. 12 is a view useful in explaining a beating 
operation of the operating terminal unit shown in FIG. 2; 

FIG. 13 is a view useful in explaining an acoustic 
25 effect-applying operation of the operating terminal unit 
shown in FIG. 2; and 

FIG. 14 is a view useful in explaining another 
acoustic ef f ect-applying operation of the operating 
terminal unit shown in FIG. 2. 

30 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will now be described in 
detail with reference to the drawings showing a preferred 
35 embodiment and variations thereof. The embodiment and 
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variations show only one aspect of the present invention, 
and the present invention can be modified and altered as 
desired within the spirit and scope thereof. 

Referring first to FIG. 1, there is shown the 
5 arrangement of a music reproduction system 100 according 
to an embodiment of the present invention. 

In FIG. 1, the music reproduction system 100 is 
comprised of an operating terminal unit OU which can be 
carried by an operator, and a personal computer system PS 
10 that receives motion information generated in response to 
motion of the operator with the operating terminal unit 
OU and transmitted from the operating terminal unit OU, 
edits existing music data (MIDI data or the like) based 
on the received motion information, and reproduces the 
15 edited music data. 

FIG. 2 is a perspective view showing the appearance 
of the operating terminal unit OU of the music 
reproduction system 100 shown in FIG. 1, while FIG. 3 is 
a block diagram showing the hardware construction of the 

2 0 operating terminal unit OU shown in FIG. 2. 

As shown in FIG. 2, the operating terminal unit OU 
of the present embodiment is of a so-called hand-held 
type that the operator uses by holding it by hand, and 
comprised of a tapered base portion (left-side portion as 
25 viewed in FIG. 2) and a tapered end portion (right-side 
portion as viewed in FIG. 2) , with opposite ends of the 
operating terminal unit OU having larger diameters and 
the central portion thereof having a smaller diameter. 

The base portion has an average diameter smaller 

3 0 than that of the end portion for easy grip, and functions 

as a grip portion. In the outer surface of the bottom 
(left end as viewed in FIG. 2) of the base portion, there 
are provided an LCD display TD and a power switch TS for 
a battery power supply, not shown, and in the outer 
3 5 surface of the central portion, there is provided an 
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operating switch T4 . On the other hand, in the vicinity 
of the distal end of the end portion, there are arranged 
a plurality of LED (Light Emitting Diode) light emitters 
TL. The operating terminal unit OU having the above 
5 described shape contains various devices. Although in 

the present embodiment, the operating terminal unit OU of 
the hand-held type is illustrated by way of example, the 
present invention is also applicable to other various 
types of operating terminal units, including a type worn 
10 on the arm or foot using a belt or the like, and a shoe 
type. 

A CPU TO appearing in FIG. 3 controls various 
components of the operating terminal unit OU including a 
motion sensor SS, based on various control programs 
15 stored in a memory Tl including a ROM and a RAM, and so 
forth . 

When musical tones are generated using the music 
reproduction system 100, the motion sensor SS detects 
motion of the operator carrying the operating terminal 

20 unit OU (e.g. a motion of the operator's hand holding the 
operating terminal unit OU) and generates motion 
information dependent on the direction, magnitude and 
speed of the motion. 

The motion sensor SS employed in the present 

25 embodiment is implemented e.g. by a two-dimensional 

acceleration sensor and comprised of an x-axis detector 
SSx for detecting acceleration in an x-axis direction 
(transverse direction) and a y-axis detector SSy for 
detecting acceleration in a y-axis direction 

3 0 (longitudinal direction) . Although in the present 

embodiment, the motion sensor SS is thus implemented, by 
way of example, by the two-dimensional acceleration 
sensor, it is also possible to employ a three-dimensional 
acceleration sensor, a three-dimensional speed sensor, a 

35 two-dimensional speed sensor or any other kind of sensor 
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which is capable of detecting operator's motion. 

A transmitter circuit T2 includes an antenna T2a, as 
well as a high-frequency transmitter and a power 
amplifier (neither of which is shown) and radio-transmits 
5 under the control of the CPU TO the motion information 

supplied from the CPU TO, to the personal computer system 
PS in FIG. 1. 

A display unit T3 includes the LCD display TD and 
the plurality of LED light emitters TL (see FIG. 2) and 
10 displays under the control of the CPU TO various 

information of a sensor number, an in-operation state, a 
power supply alarm, and so forth. 

The operating switch T4 is for switching on/off the 
power supply to the operating terminal unit OU and 
15 setting various operation modes thereof. Driving power 
is supplied to the above components from the battery 
power supply, which may be formed by a primary battery, 
or alternatively by a rechargeable secondary battery. 
FIG. 4 shows the arrangement of the personal 
20 computer system PS in FIG. 1. 

As shown in FIG. 4, the personal computer system PS 
has not only the same functions as those of an ordinary 
personal computer, but also the function of receiving 
motion information radio-transmitted from the operating 
25 terminal unit OU, the function of editing existing music 
data based on the received motion information, and the 
function of reproducing the edited music data. 

A main unit CPU MO performs control of the overall 
operation of the personal computer system PS, including 
3 0 various kinds of control, described in detail hereinafter, 
based on predetermined programs under time control by a 
timer Ml used in generating a tempo clock and an 
interrupt clock. 

A memory M2 includes a nonvolatile memory, such a 
35 ROM, and a volatile memory, such a RAM. The memory M2 
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stores an operating system executed by the main unit CPU 
MO, predetermined control programs for controlling the 
personal computer system PS, and so forth. 

A receiving and processing circuit M3 , to which is 
5 connected an antenna and distributor circuit M3a 

comprised of a multi-channel high-frequency receiver, 
receives the motion information transmitted from the 
operating terminal unit OU via an antenna M3b and the 
antenna and distributor circuit M3a, and performs 

10 predetermined signal processing on the received signal. 

Connected to a detector circuit M4 are a keyboard 
M4a and a mouse, not shown. The operator uses the 
keyboard M4a and/or the mouse to carry out various 
setting operations including setting of various modes 

15 necessary for performance data control and setting of 
tone colors (tone sources) to performance tracks. 

Connected to a display circuit M5 is a liquid 
crystal panel M5a, on which various information of music 
data being currently edited is displayed. 

20 An external storage device M6 is implemented by at 

least one storage device, such as a hard disk drive (HDD) , 
a compact disk read only memory (CD-ROM) drive, a floppy 
disk drive (FDD) , a magneto-optical (MO) disk drive, and 
a digital versatile disk (DVD) drive, and capable of 

25 storing existing music data and edited music data. 

A musical tone generator M7 generates musical tones 
based on edited music data (hereinafter referred to as 
"user's original music data") supplied from the main unit 
CPU MO and is comprised of a tone generator circuit M7a, 

30 an effect circuit M7b, and a speaker system M7c. 

The tone generator circuit M7a reads the user's 
original music data supplied from the main unit CPU MO, 
to thereby sequentially generate music signals 
corresponding to the user's original music data. 

35 The effect circuit M7b is implemented e.g. by a DSP 
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(Digital Signal Processor) and imparts various acoustic 
effects to the musical tone signals generated by the tone 
generator circuit M7a 7 and outputs the resulting musical 
tone signals to the speaker system M7c. 
5 The speaker system M7c includes an D/A converter and 

an amplifier, neither of which is shown, and converts a 
musical tone signal received from the tone generator 
circuit M7a via the effect circuit M7b to musical tones 
for output. 

10 In the following, the functions of the personal 

computer system PS shown in FIG. 4 will be described with 
reference to FIG. 5 and other figures. 

FIG. 5 is a diagram useful in explaining the 
functions of the personal computer system PS shown in FIG. 

15 4. 

When the operator holds and operates by hand the 
operating terminal unit OU shown in FIG. 2 which contains 
the motion sensor SS, motion information generated based 
on the direction, magnitude, and speed of the motion of 

20 the operating terminal unit OU being operated is 

transmitted from the operating terminal unit OU to the 
personal computer system PS. More specifically, the x- 
axis detector SSx and y-axis detector SSy of the motion 
sensor SS of the operating terminal unit OU output an 

25 acceleration sensor signal ax indicative of an 

acceleration in the x direction (transverse direction) 
and an acceleration sensor signal ay indicative of an 
acceleration in the y direction (longitudinal direction) , 
respectively, and these acceleration sensor signals ax, 

3 0 ay are transmitted as the motion information from the 
operating terminal unit OU to the personal computer 
system PS. 

In FIGS. 4 and 5, after receiving the acceleration 
sensor signals ax, ay via the antenna M3b, the antenna 
3 5 and distributor circuit M3a outputs these signals to the 
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receiving and processing circuit M3 . The receiving and 
processing circuit M3 carries out predetermined filtering 
processing on the signals ax, ay sequentially supplied 
from the antenna and distributor circuit M3a to remove 
5 noise components contained therein, and then outputs the 
processed acceleration sensor signals as acceleration 
data ax, ay to the main unit CPU MO, 

When receiving the acceleration data ax, ay from 
the receiving and processing circuit M3, a local 

10 peak/dynamics detector M01 analyzes the acceleration data 
to obtain an acceleration value a indicative of the 
magnitude of an acceleration vector as the sum of 
respective vectors of accelerations in the x-axis 
direction and the y-axis direction/ and thereby detect a 

15 local peak and dynamics . 

FIG . 6 is a timing chart illustrating an example of 
changes in the acceleration value a of the operating 
terminal unit OU shown in FIG. 2. 

When the acceleration value a is determined based 

20 on the acceleration data ax, ay, the local peak/dynamics 
detector M01 starts detecting peaks (peak information) of 
the acceleration value a . Upon detection of a peak, the 
local peak/dynamics detector M01 determines whether or 
not an acceleration value (peak value) corresponding to 

25 the peak is positive (assuming that values of 

acceleration in the moving direction of the operating 
terminal unit OU are positive) . If the detected peak 
value is negative (see a peak value pll in FIG. 6) , the 
local peak/dynamics detector M01 continues detection of 

30 peaks. 

On the other hand, if the detected peak value is 
positive (see a peak value pl2 in FIG. 6), the local 
peak/dynamics detector M01 reads out a first threshold 
value tl (>0) and a second threshold value t2 (>tl) 
35 stored in advance in the memory M2, and performs 
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comparison between the threshold values tl, t2 and the 
peak value (e.g. the peak value pl2) detected this time. 
The first and second threshold values tl and t2 stored in 
the memory M2 can be preset e.g. when the personal 
5 computer system PS is manufactured, but an operator may 
be allowed to set or change them freely e . g \ by operating 
the keyboard M4a of the personal computer sysjtem PS. 

If it is determined that the peak value detected 
this time is larger than the first threshold value tl and 

10 at the same time larger than the second threshold value 
t2 (see the peak value pl2 in FIG. 6) , the local 
peak/dynamics detector M01 judges that a beating 
operation is intended by the operator. When a peak 
exceeding both the first threshold value tl and the 

15 second threshold value t2 (hereinafter referred to as "a 
first local peak" for convenience of description) is 
detected as described above, the local peak/dynamics 
detector M01 calculates the difference between the value 
of the peak (e.g. the peak value pl2) and the 

20 corresponding negative peak value (e.g. the peak value 
pll) as a dynamics value (see dynamics values D in FIG. 
6), and sends the obtained dynamics value D and a 
notification that the first local peak has been detected, 
to a music reproduction controller M02 . 

25 The music reproduction controller M02 determines the 

volume level of a musical tone to be reproduced, based on 
the dynamics value D sent from the local peak/dynamics 
detector M01, and determines a performance tempo of the 
musical tone to be reproduced based on a time interval 

30 between the two first local peaks from the last detected 
by the local peak/dynamics detector M01. More 
specifically, the memory M2 stores a volume level 
determination table, not shown, in which dynamics values 
D are associated with volume levels of musical tones to 

35 be reproduced, and when receiving a dynamics value D from 
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the local peak/dynamics detector M01, the music 
reproduction controller M02 refers to the volume level 
determination table to obtain a volume level 
corresponding to the dynamics value D. 
5 Further, when notified by the local peak/dynamics 

detector M01 that the first local peak has been detected, 
the music reproduction controller M02 refers to a timer, 
not shown, and records in the memory M2 the time the 
notification was received. Whenever the notification 

10 that a first local peak has been detected is received 
from the local peak /dynamics detector M01, the music 
reproduction controller M02 repeatedly carries out the 
operation to determine a time interval between two first 
local peaks from the last. The memory M2 also stores a 

15 performance tempo determination table, not shown, in 
which detected time intervals between pairs of first 
local peaks are associated with performance tempos of the 
musical tone to be reproduced. When a time interval 
between first local peaks is determined as described 

20 above, the music reproduction controller M02 refers to 
the performance tempo determination table to obtain a 
performance tempo corresponding to the determined time 
interval between the first local peaks. The music 
reproduction controller M02 determines a volume level and 

25 a performance tempo as described above, and delivers 
these as music reproduction control information to a 
music data-editing device M05. 

On the other hand, if the peak value detected this 
time is larger than the first threshold value tl and at 

30 the same time smaller than the second threshold value t2 
(see a peak value p22 in FIG. 6), the local peak/dynamics 
detector M01 judges that not a beating operation but 
acoustic effect application is intended by the operator. 
When a peak larger than the first threshold value tl and 

35 at the same time smaller than the second threshold value 
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t2 (hereinafter referred to as "a second local peak" for 
convenience of description) is detected as described 
above, the local peak/dynamics detector M01 calculates 
the difference between the value of the peak (e.g. the 
5 peak value p22) and the corresponding negative peak value 
(e.g. the peak value p21) as a dynamics value (see 
dynamics values d in FIG. 6), and sends the obtained 
dynamics value d and a notification that the second local 
peak has been detected, to an acoustic effect application 

10 controller M03 . 

A locus shape/direction detector M04 determines 
information of a movement locus (hereinafter simply 
referred to as movement locus information) of the 
operating terminal unit OU based on the acceleration data 

15 ax, ay supplied from the receiving and processing 

circuit M3 . It should be noted that the movement locus 
information includes locus shape information indicative 
of a shape (e.g. a circular shape, a triangular shape, 
etc.) of the corresponding movement locus, and locus 

20 direction information indicative of a direction (e.g. a 
transverse direction, a horizontal direction, a 
rotational direction, etc.) in which the movement locus 
was drawn. 

FIGS. 7A and 7B are diagrams useful in explaining 
25 movement locus information of the operating terminal unit 
OU shown in FIG. 2, which is generated by the locus 
shape/direction detector in FIG. 5. 

For example, when the operator moves the operating 
terminal unit OU clockwise as viewed from the operator's 
30 side, drawing a small circle, movement locus information 
shown in FIG. 7B is generated by the locus 
shape/direction detector M04. More specifically, locus 
shape information indicating that the shape of the 
movement locus drawn by the operating terminal unit OU is 
35 "circular" and locus direction information indicating 
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that the direction of the movement locus drawn by the 
operating terminal unit OU is ''clockwise" are generated 
by the locus shape/direction detector M04. 

The memory M2 stores a locus shape identification 
5 table, not shown, for uniquely identifying the shape of a 
movement locus and a locus direction identification table, 
not shown, for uniquely identifying a direction in which 
a movement locus is drawn. More specifically, in the 
locus shape identification table, there are registered 

10 various shapes including shapes in FIGS. 8A to 8F, i.e. 

"f igure-of-8" (FIG. 8A) , "obliquely cut shape' 7 (FIG. 8B) , 
"square shape" (FIG. 8C) , "spiral shape" (FIG. 8D) , "saw- 
toothed shape" (FIG. 8E) , and "triangular shape" (FIG. 
8F) , in addition to the above-mentioned "circular shape" . 

15 The locus shape/direction detector M04 determines which 
one of the various shapes registered in the locus shape 
identification table agrees with (or most closely 
resembles) the shape of a movement locus determined by 
analyzing the acceleration data ax, ay, to thereby 

20 identify the locus shape information. 

In the locus direction identification table, there 
are registered moving directions of the operating 
terminal unit OU and acceleration data displacement 
information indicative of displacement of acceleration 

25 data ax, ay obtained in response to the operation of the 
operating terminal unit OU, in association with each 
other. More specifically, in the locus direction 
identification table, various operating directions, such 
as "vertical direction", "horizontal direction", 

30 "counterclockwise direction" and "clockwise direction", 
are registered in association with respective pieces of 
acceleration data displacement information. Upon 
reception of the acceleration data ax, ay from the 
receiving and processing circuit M3 , the locus 

35 shape/direction detector M04 refers to the locus 
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direction identification table to identify the locus 
direction information . 

The locus shape/direction detector M04 thus obtains 
locus shape information and locus direction information, 
5 and then outputs movement locus information including the 
locus shape information and the locus direction 
information to the acoustic effect application controller 
M03 . 

The acoustic effect application controller M03 

10 determines an item of an acoustic effect to be applied, 

based on the movement locus information supplied from the 
locus shape/direction detector M04, and at the same time 
determines a level of the acoustic effect based on a 
dynamics value d supplied from the local peak/dynamics 

15 detector M01. 

FIG. 9 is a diagram useful in explaining an acoustic 
effect item determination table TA stored in the memory 
M2 in FIG. 4, while FIG. 10 is a diagram useful in 
explaining an acoustic effect level determination table 

20 TB stored in the memory M2 . 

As shown in FIG. 9, in the acoustic effect item 
determination table TA, locus shape information, locus 
direction information, and acoustic effect items are 
registered in association with each other. The acoustic 

25 effect items include various acoustic effect items, such 
as "tone extension" indicative of prolonging the duration 
of a tone being sounded, such as fermata, slur, or tenuto, 
* first sound effect" indicative of adding a sound effect 
such as wave sound, "reverberation" indicative of 

30 applying a reverberation effect, "vibrato" indicative of 
vibrating the pitch of a tone, "chorus" indicative of 
applying a choral effect, and "second sound effect" 
indicative of adding a sound effect, such as clap sound. 
On the other hand, as shown in FIG. 10, in the 

35 acoustic effect level determination table TB, dynamics 
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values and acoustic effect levels are registered for each 
of the acoustic effect items, in such a manner that 
dynamics values are associated with respective acoustic 
effect levels. The acoustic effect level is indicative 
5 of the intensity, depth, or the like of an acoustic 

effect. For example, the acoustic effect levels in the 
acoustic effect item "first sound effect" are indicative 
of degrees of loudness of the first sound effect, and the 
acoustic effect levels in the acoustic effect item 

10 "reverberation" are indicative of degrees of depth of 
reverberation . 

Upon reception of the movement locus information 
from the locus shape/direction detector M04, the acoustic 
effect application controller M03 searches the acoustic 

15 effect item determination table TA shown in FIG. 9 using 
locus shape information and locus direction information 
included in the movement locus information, as retrieval 
keys . 

Now, let it be assumed that the movement locus 

20 information includes locus shape information indicative 
of the "circular shape" and locus direction information 
indicative of the "clockwise direction". In this case, 
the acoustic effect application controller M03 searches 
the acoustic effect item determination table TA using 

25 these pieces of information as retrieval keys, to thereby 
obtain the acoustic effect item "tone extension". 
Similarly, if the movement locus information includes 
locus shape information indicative of the "saw- toothed 
shape" and locus direction information indicative of the 

30 "vertical direction", the acoustic effect application 
controller M03 searches the acoustic effect item 
determination table TA using these pieces of information 
as retrieval keys, to thereby obtain the acoustic effect 
item "reverberation" . Determination of the other 

35 acoustic effect terms can be carried out similarly, and 
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therefore further description is omitted. 

After determining an acoustic effect item as 
described above, the acoustic effect application 
controller M03 searches the acoustic effect level 
5 determination table TB shown in FIG. 10 using the 

determined acoustic effect item and a dynamics value d 
supplied from the local peak/dynamics detector M01 as 
retrieval keys . 

Assuming that the determined acoustic effect item is 

10 * reverberation" and that the supplied dynamics value d is 
within a range of cO to cl, the acoustic effect 
application controller M03 searches the acoustic effect 
level determination table TB using these pieces of 
information as retrieval keys, to thereby obtain an 

15 acoustic effect level "level 1". Determination of the 

other acoustic effect levels can be carried out similarly, 
and therefore further description is omitted. After thus 
determining an acoustic effect item indicative of the 
kind of an acoustic effect to be applied and an acoustic 

20 effect level indicative of the intensity, loudness, or 
the like of the acoustic effect, the acoustic effect 
application controller M03 outputs these pieces of 
information as acoustic effect control information to the 
music data-editing device M05 (see FIG. 5) . 

25 The music data-editing device M05 edits the existing 

music data stored in an existing music data storage 
device M06, based on the music reproduction control 
information indicative of a volume level and a 
performance tempo, which has been supplied from the music 

3 0 reproduction controller M02, and the acoustic effect 

control information indicative of an acoustic effect item 
and an acoustic effect level, which has been supplied 
from the acoustic effect application controller M03 . 

FIG. 11 is a diagram useful in explaining existing 

35 music data stored in the existing music data storage 
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device M06 in FIG. 5. 

As shown in FIG. 11, existing music data includes a 
music reproduction control code and an acoustic effect 
control code. 

5 The music reproduction control code includes a 

performance tempo control code for controlling the 
performance tempo and a volume control code for 
controlling the volume. 

The acoustic effect control code is comprised of 

10 various control codes, such as a reverberation control 
code for applying the reverberation effect, a tone 
extension control code for applying the effect of tone 
extension, and a sound effect control code for applying a 
sound effect, which correspond to the above -described 

15 acoustic effect items, respectively. 

The music data-editing device M05 rewrites a volume 
level indicated by the volume control code and/or a 
performance tempo indicated by the performance tempo 
control code, based on the music reproduction control 

20 information supplied from the music reproduction 

controller M02 . Further, based on the acoustic effect 
control information supplied from the acoustic effect 
application controller M03, the music data-editing device 
M05 rewrites an acoustic effect level (e.g. a 

25 reverberation effect level) indicated by a corresponding 
one of the control codes of the acoustic effect control 
code (e.g. the reverberation control code) corresponding 
to the acoustic effect control information, or adds a 
corresponding one of the control codes of the 

3 0 corresponding acoustic effect control code. 

After thus editing the existing music data to 
generate new music data (user's original music data) 
reflecting a musical concept in the operator's mind, the 
music data-editing device M05 transfers the new music 

35 data to a user's original music data storage device M07 
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and outputs the same to the musical tone generator M7 . 

The musical tone generator M7 generates musical tone 
signals based on the user's original music data supplied 
from the music data-editing device MOB, and outputs the 
5 musical tone signals as musical tones through the speaker 
system M7c. Thus, performance tones reflecting the 
musical concept in the operator's mind are sequentially 
sounded from the musical tone generator M7 . 

On the other hand, if the peak value detected this 

10 time is below the first threshold value tl as in FIG. 6, 
the local peak/dynamics detector M01 judges that the 
operator has no intention (i.e. the local peak/dynamics 
detector M01 judges that noise has been generated) , and 
does nothing. In this case, performance tones are 

15 sequentially sounded from the musical tone generator M7 , 
based on the existing music data. 

In the following, a description will be given of 
operations performed in editing and reproducing existing 
music data by using the music reproduction system 100 

20 shown in FIG. 1. 

First, the operator holding the operating terminal 
unit OU operates the power switch TS and the operating 
switch T4 thereof, as well as an operating section, not 
shown, of the personal computer system PS, to start the 

25 operating terminal unit OU and the personal computer 
system PS. Then, the operator operates the operating 
section to select data of a piece of music (music data) 
to be edited and reproduced from data of a plurality of 
pieces of music stored in the external storage device M6 . 

3 0 When the music data has been selected by the 

operator, the main unit CPU M0 of the personal computer 
system PS reads out the music data from the external 
storage device M6, and stores the same in the existing 
music data storage device M06. The main unit CPU M0 

3 5 grasps a part composition of the music data by referring 
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to part composition information added to a header or the 
like of the music data. Then, the main unit CPU MO 
displays the part composition of the music data on the 
liquid crystal panel M5a to prompt the operator to select 
5 a part of which music data he/she desires to edit and 
reproduce . 

The operator checks contents displayed on the liquid 
crystal panel M5a, and then selects one (e.g. a piano 
part) or more parts (e.g. all the parts) for editing and 

10 reproduction. Although in the present embodiment, a 

performance part or performance parts to be edited and 
reproduced is /are selected by the operator, the 
performance part or parts may be automatically selected 
by the personal computer system PS. 

15 After thus selecting the part(s) to be edited and 

reproduced, the operator operates the operating section 
to enter an instruction for starting reproduction of the 
music data, and then starts operating the operating 
terminal unit OU. 

2 0 Let it be assumed that at this time, the operator 

moves the operating terminal unit OU so as to draw a big 
triangle as in FIG. 12. In this case, motion information 
(more specifically, acceleration sensor signals ax, ay 
indicative of respective accelerations in the x-axis and 

25 y-axis directions) corresponding to the operator's 

operation of the operating terminal unit OU is generated 
by the motion sensor SS, and transmitted to the personal 
computer system PS. 

The local peak/dynamics detector M01 of the personal 

30 computer system PS sequentially receives pieces of the 
motion information via the antenna and distributor 
circuit M3a and the receiving and processing circuit M3 , 
and determines an acceleration value a as described 
above (see FIG. 6) , to thereby detect a local peak and 

3 5 dynamics. 
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If it is determined at this time that the detected 
peak value is larger than the first threshold value tl 
and at the same time larger than the second threshold 
value t2, the local peak/dynamics detector M01 judges 
5 that a beating operation is intended by the operator, and 
determines a dynamics value D. Then, the local 
peak/dynamics detector M01 sends the obtained dynamics 
value D and a notification that a first local peak has 
been detected, to the music reproduction controller M02 . 

10 The music reproduction controller M02 determines volume 
levels based on dynamics values D sequentially supplied 
from the local peak/dynamics detector M01, and at the 
same time determines a performance tempo based on a time 
interval between first local peaks detected by the local 

15 peak/dynamics detector M01, followed by outputting these 
as the music reproduction control information to the 
music data-editing device M05. 

The music data-editing device M05 edits existing 
music data of a predetermined part or predetermined parts 

20 (i.e. the part(s) selected by the operator) read out from 
the existing music data storage device M06, based on the 
music reproduction control information received from the 
music reproduction controller M02 . Then, the music data- 
editing device M05 stores music data obtained by editing 

25 the existing music data of the predetermined part(s), i.e. 
user's original music data in the user's original music 
data storage device M07, and also delivers the user's 
original music data to the musical tone generator M7 . As 
a result, performance tones are sounded from the musical 

3 0 tone generator M7 with the part volume and performance 
tempo being controlled based on the beating operation 
performed by the operator. 

On the other hand, assuming that the operator moves 
the operating terminal unit OU so as to draw a small 

35 circle as in FIG. 13 during (or after) the beating 
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operation, similarly to the above, motion information 
(more specifically, the acceleration sensor signals ax, 
ay indicative of respective accelerations in the x-axis 
and y-axis directions) corresponding to the operation is 
5 generated by the motion sensor SS and transmitted to the 
personal computer system PS. 

After receiving pieces of the motion information via 
the antenna and distributor circuit M3a and the receiving 
and processing circuit M3, the local peak/dynamics 

10 detector M01 of the personal computer system PS 

determines an acceleration value a as described above 
(see FIG. 6), to thereby detect a local peak and dynamics. 

If it is determined at this time that the detected 
peak value is larger than the first threshold value tl 

15 and at the same time smaller than the second threshold 
value t2, the local peak/dynamics detector M01 judges 
that acoustic effect application is intended by the 
operator, and determines a dynamics value d. Then, the 
local peak/dynamics detector M01 sends the obtained 

2 0 dynamics value d and a notification that a second local 

peak has been detected to the acoustic effect application 
controller M03 . 

The locus shape /direction detector MO 4 determines 
movement locus information including locus shape 

25 information (locus shape information indicative of the 
"circular shape" in the illustrated example of FIG, 13) 
and locus direction information (locus direction 
information indicative of the "clockwise direction" in 
the the illustrated example of FIG. 13) based on the 

30 motion information received via the receiving and 

processing circuit M3 , and outputs the obtained movement 
locus information to the acoustic effect application 
controller M03. 

When receiving the dynamics value d from the local 

3 5 peak/dynamics detector M01 and the movement locus 
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information from the locus shape/direction detector M04, 
the acoustic effect application controller M03 determines 
an acoustic effect item to be applied and an acoustic 
effect level by referring to the acoustic effect item 
5 determination table TA shown in FIG. 9 and the acoustic 
effect level determination table TB shown in FIG. 10. 
Then, the acoustic effect application controller M03 
outputs the thus determined acoustic effect item (tone 
extension in the illustrated example of FIG. 13) and 

10 acoustic effect level (level 1 in the illustrated example 
of FIG. 13) as acoustic effect control information to the 
music data-editing device MOB. 

The music data-editing device M05 edits the existing 
music data of the predetermined part(s) based on the 

15 acoustic effect control information supplied from the 
acoustic effect application controller M03 . Then, the 
music data-editing device M05 stores the edited music 
data, i.e. the user's original music data in the user's 
original music data storage device M07, and delivers the 

20 data to the musical tone generator M7 at the same time. 
As a result, performance tones are sounded from the 
musical tone generator M7 with the acoustic effect 
applied thereto in response to the acoustic effect- 
applying operation (tone extension effect -applying 

25 operation in the illustrated example of FIG. 13) 

performed by the operator. The operation in the case 
where the operator performs operation for applying 
another acoustic effect during (or after) the beating 
operation (see e.g. a reverberation effect-applying 

3 0 operation in FIG. 14) is almost the same as the above 

described operation, and therefore description thereof is 
omitted. 

As described above, the music reproduction system 
^ 100 according to the present embodiment enables an 

35 operator to control the performance tempo and whole 
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volume of a piece of music as well as to apply desired 
acoustic effects to the piece of music e,g. according to 
the musical concept in his/her mind, merely by simple 
operations of the hand-held operating terminal unit OU, 
5 in real time while listening to the piece of music being 
reproduced by the personal computer system PS, Therefore, 
even a beginner having no knowledge of MIDI or the like 
can apply acoustic effects easily and intuitively by 
simple operations of the operating terminal unit OU. 

10 In other words, the music reproduction system 100 

according to the present embodiment makes it unnecessary 
to carry out operations which were conventionally 
necessary for acoustic effect application, that is, an 
operation of learning code names for acoustic effect 

15 application, and an operation of learning what degree of 
numeric value should be input to obtain what degree of an 
acoustic effect that is actually applied to music, for 
each of acoustic effects. 

Further, conventionally, it was necessary to stop 

20 music reproduction temporarily to enter such a code and a 
numeric value. Besides, after the entry operation, it 
was necessary to reproduce the edited portion to confirm 
the result of the editing, which takes the operator a lot 
of time and labor for editing and reproducing a single 

25 piece of music. By contrast, with the music reproduction 
system 100 according to the present embodiment, an 
acoustic effect can be applied in real time by a simple 
operation of moving the operating terminal unit OU, 
whereby it is possible to considerably reduce time and 

30 labor required for editing and reproducing a piece of 
music. 

The above described embodiment of the present 
invention is given only by way of example, and various 
changes and modifications may be made without departing 
3 5 from the spirit and scope of the present invention. The - 
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following are examples of possible variations of the 
above described embodiment. 

Although in the above described embodiment, when the 
peak value is larger than the first threshold value tl 
5 and at the same time larger than the second threshold 
value t2 , it is judged that a beating operation is 
intended by the operator, and when the peak value is 
larger than the first threshold value tl and at the same 
time smaller than the second threshold value t2, it is 

10 judged that acoustic effect application is intended by 
the operator, this is not limitative, but as a first 
variation of the present embodiment, it may be configured 
such that conversely to the above, when the peak value 
exceeds not only the first threshold value tl but also 

15 the second threshold value t2 , it is judged that acoustic 
effect application is intended by the operator, and when 
the peak value is larger than the first threshold value 
tl and smaller than the second threshold value t2, it is 
judged that a beating operation is intended by the 

20 operator. 

Further, although in the above described embodiment, 
whenever a second local peak is detected, a dynamics 
value d corresponding to the second local peak is 
determined and sent to the acoustic effect application 

25 controller M03, this is not limitative, but as a second 

variation of the present embodiment, it may be configured 
such that in view of variations in the dynamics value, an 
average value of a plurality of dynamics values d 
corresponding respectively to second local pea.ks is 

3 0 determined and sent to the acoustic effect application 
controller M03 (see FIG. 6) . 

Furthermore, although in the above described 
embodiment, a single operating terminal unit OU is used 
for editing and reproducing music data, this is not 

35 limitative, but a third variation of the present 
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embodiment is possible in which a plurality of operating 
terminal units OU are used for editing and reproducing 
music data. In this case, the CPU TO of each operating 
terminal unit OU adds identification information 
5 (hereinafter simply referred to as a terminal ID) for 
identifying the operating terminal unit OU itself to 
motion information generated by the motion sensor SS, and. 
then transmits the resulting motion information to the 
personal computer system PS. 

10 The memory M2 of the personal computer system PS 

stores terminal ID's for identifying the respective 
operating terminal units OU under the control of the 
personal computer system PS. When receiving the motion 
information via the antenna and distributor circuit M3a 

15 and the receiving and processing circuit M3 , the main 

unit CPU MO of the personal computer system PS compares 
the terminal ID added to the motion information with the 
terminal ID's stored in the memory M2 , to identify the 
operating terminal unit OU that sent the motion 

20 information. Further, the main unit CPU MO selects one 
(e.g. a violin part) or more parts (e.g. all the parts) 
to be edited and reproduced by referring to a part 
assignment table, not shown, stored in the memory M2 . 

In the part assignment table, there are registered 

25 terminal ID's and parts to be edited and reproduced in 

association with each other. For an example, in the part 
assignment table, a terminal ID-1 is associated with the 
violin part, a terminal ID-2 with the cello part, and the 
piano part, and a terminal ID-k with the trumpet 

30 part. When acquiring the terminal ID added to the motion 
information, the main unit CPU MO then searches the part 
assignment table using the terminal ID as a retrieval key. 

After the main unit CPU MO identifies the part(s) to 
be edited and reproduced by searching the part assignment 

3 5 table , the same operations as those of the above 
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described embodiment are carried out, and therefore 
description thereof is omitted. 

Further, although in the above described embodiment, 
the acoustic effect level is determined based on the 
5 dynamics value (see the acoustic effect level 

determination table TB shown in FIG. 10) , this is not 
limitative, but as a fourth variation, it may be 
configured such that the acoustic effect level is 
determined based on the time interval {second peak 

10 detection interval) T between detections of two second 

peaks shown in FIG. 6. For example, when the second peak 
detection interval is short, the acoustic effect level is 
set high, whereas when the second peak detection interval 
is long, the acoustic effect level is set low. 

15 Moreover, although in the above described embodiment 

and variations, the operating terminal unit OU and the 
personal computer system PS are provided in separate 
bodies, this is not limitative, but as a fifth variation, 
it may be configured such that the operating terminal 

20 unit OU has incorporated therein various hardware 

resources forming the personal computer system PS to 
integrate the personal computer system PS into the 
operating terminal unit OU, and the editing and 
reproduction of music data is executed by the operating 

25 terminal unit OU. 

The present invention may either be applied to a 
system composed of a plurality of apparatuses or to a 
single apparatus. 

It is to be understood that the functions of the 

3 0 main unit CPU MO of the personal computer system PS and 
the CPU TO of the operating terminal unit according to 
the present embodiment and variations, described above, 
can also be realized by software. It also goes without 
saying that the object of the present invention may be 

35 accomplished by supplying a system or an apparatus with a 
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storage medium in which a program code of software which 
realizes the functions of any of the above described 
embodiment and variations, and causing a computer (CPU or 
MPU) of the system or apparatus to read out and execute 
5 the program code stored in the storage medium. 

In this case, the program code itself read from the 
storage medium realizes the functions of any of the above 
described embodiment and variations, and hence the 
storage medium on which the program code is stored 

10 constitutes the present invention. 

Examples of the storage medium for supplying the 
program code include a floppy (registered trademark) disk, 
a hard disk, an optical disk, a magneto optical disk, a 
CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, a DVD-RW, 

15 a DVD+RW, a magnetic tape, a nonvolatile memory card, and 
a ROM. Downloading via a network can also be utilized. 

Further, it is to be understood that the functions 
of any of the above described embodiment and variations 
may be accomplished not only by executing a program code 

20 read out by a computer, but also by causing an OS 

(operating system) or the like which operates on the 
computer to perform a part or all of the actual 
operations based on instructions of the program code. 

Further, it is to be understood that the functions 

25 of any of the above described embodiment and variations 
may be accomplished by writing a program code read out 
from the storage medium into a memory provided on an 
expansion board inserted into a computer or in an 
expansion unit connected to the computer and then causing 

3 0 a CPU or the like provided in the expansion board or the 
expansion unit to perform a part or all of the actual 
operations based on instructions of the program code. 

The entire content of Priority Document No. 2002-211322 is 
incorporated herein by reference . 



